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5 Web servers with queryable dynamic caches 

Background of the invention 

10 1. Field of the invention 

The invention concerns caching of data in networks generally and more specifically 
concerns the caching of queryable data in network servers. 

2. Description of the prior art 

15 Once computers were coupled to communications networks, remote access to data 
became far cheaper and easier than ever before. Remote access remained the domain of 
specialists, however, since the available user interfaces for remote access were hard to 
learn and hard to use. The advent of World Wide Web protocols on the Internet have 
finally made remote access to data available to everyone. A high school student sitting at 

20 home can now obtain information about Karlsruhe, Germany from that city's Web site 
and a lawyer sitting in his or her office can use a computer manufacturer's Web site to 
determine what features his or her new PC ought to have and then configure, order, and 
pay for the PC 

25 A consequence of the new ease of remote access and the new possibilities it offers for 
information services and commerce has been an enormous increase in the amount of 
remote access. This has in turn lead to enormous new burdens on the services that 
provide remote access and the resulting performance problems are part of the reason why 
the World Wide Web has become the World Wide Wait. 

30 

FIG. 1 shows one of the causes of the performance problems. At 101, there is shown the 
components of the system which make it possible for a user at his or her PC to access an 
information source via the World Wide Web. Web browser 103 is a PC which is running 
Web browser software. The Web browser software outputs a universal resource locator 
35 (URL) 104 which specifies the location of a page of information in HTML format in the 
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5 World Wide Web and displays HTML pages to the user. The URL may have associated 
with it a message containing data to be processed at the site of the URL as part of the 
process of obtaining the HTML page. For example, if the information is contained in a 
database, the message may specify a query on the data base. The results of the query 
would then be returned as part of the HTML page. Internet 105 routes the URL 104 and 

10 its associated message to the location specified by the URL, namely Web server 107, 
There, HTML program 109 in Web server 107 makes the HTML page 106 specified by 
the URL and returns it to Web browser 103. If the message specifies a query on the 
database in database server 115, HTML program 109 hands the message off to Web 
application program 111, which translates the message into a query in the form required 

15 by data access layer 1 12. 

Data access layer 1 12 is generally provided by the manufacturer of database server 115. 
It takes queries written in standard forms such as OLE-DB, ODBC, or JOBC, converts 
the queries into the form required by database server 115, and places the queries in 
20 messages in the form required by network 113. Database server 115 then executes the 
query and returns the result via network 113 to data access layer 112, which puts the 
results into the required standard form and returns them to Web application 111, which in 
turn puts the result into the proper format for HTML program 109. HTML program 109 
then uses the result in making the HTML page 106 to be returned to browser 103. 

25 

As may be seen from the above description, a response to a URL specifying a page 
whose construction involves database server 115 requires four network hops: one on 
Internet 105 from browser 103 to Web server 107, one on network 113 from server 107 
to server 115, one on network 1 13 from server 1 15 to server 107, and one on Internet 105 
30 from server 107 to browser 103. If more than one query is required for an HTML page, 
there will be a round trip on network 1 13 for each query. 

Moreover, as shown at 1 17, a typical Web transaction is a series of such responses: the 
first HTML page includes the URL for a next HTML page, and so forth. The 
35 transaction shown at 1 17 begins with a request for an HTML page that is a form which 
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5 the user will fill out to make the query; data base server 115 provides the information for 
the HTML page. When that page is returned, the user fills out the form and when he or 
she is finished, the browser returns a URL with the query from the form to server 107, 
which then deals with the query as described above and returns the result in another 
HTML page. That page permits the user to order, and when the user orders, the result is 

10 another query to database server 115, this time, one which updates the records involved 
in the transaction. 

Not only do Web transactions made as shown in FIG. 1 involve many network hops, they 
also place a tremendous burden on data base server 115. For example, if data base server 
15 115 belongs to a merchant who sells goods on the Web and the merchant is having a 
special, many of the transactions will require exactly the same sequence of HTML pages 
and will execute exactly the same queries, but because system 101 deals with each 
request from a web browser individually, each query must be individually executed by 
database server 115. 

20 

The problems of system 101 are not new to the designers of computer systems. There are 
many situations in a computer system where a component of the system needs faster 
access to data from a given source, and when these situations occur, the performance of 
the system can be improved if copies of data that is frequently used by the component are 
25 kept at a location in the system to which the component has faster access than it has to the 
source of the data. When such copies exist, the location at which the copies are kept is 
termed a cache and the data is said to be cached in the system. 

Caching is used at many levels in system 101. For example, browser 103 keeps a cache 
30 of previously-displayed HTML pages, so that it can provide a previously-displayed 
HTML page to the user without making a request for the page across Internet 105. Web 
server 107 similarly may keep a cache of frequently-requested HTML pages, so that it 
can simply return the page to the user, instead of constructing it. Database server 115, 
finally, may keep a cache of the information needed to answer frequently-made queries, 
35 so that it can return a result more quickly than if it were starting from scratch. In system 
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5 101, the most effective use of caching is in Web server 107, since data that is cached 
there is still accessible to all users of internet 105, while the overhead of the hops on data 
access 113 is avoided. 

Any system which includes caches must deal with two problems: maintaining 
10 consistency between the data in the cache and the data in the data source and choosing 
which data to cache. In system 101, the first problem is solved in the simplest way 
possible: it is the responsibility of the component using the data to determine when it 
needs a new copy of the data from the data source. Thus, in browser 103, the user will 
see a cached copy of a previously- viewed HTML page unless the user specifically clicks 
15 on his browser's "reload" button. Similarly, it is up to HTML program 109 to determine 
when it needs to redo the query that provided the results kept in a cached HTML page. 
The second problem is also simply solved: when a new page is viewed or provided, it 
replaces the least recently-used cached page. 

20 Database systems such as the Oracle8™ server, manufactured by Oracle Corporation and 
described in Leverenz, et al. ; Oracle8 Server Concepts, release 8.0, Oracle Corporation, 
Redwood City, CA, 1998., move a copy of a database closer to its users by replicating 
the original database at a location closer to the user. The replicated data base may 
replicate the entire original or only a part of it. Partial replications of a database are 

25 termed table snapshots. Such table snapshots are read-only. The user of the partial 
replication determines what part of the original database is in the table snapshot. 
Consistency with the original database is maintained by snapshot refreshes that are made 
at times that are determined by the user of the table snapshot. In a snapshot refresh, the 
table snapshot is updated to reflect a more recent state of the portion of the original 

30 database contained in the snapshot. For details, see pages 30-5 through 30-11 of the 
Leverenz reference. 

There are many applications for which the solution of letting the component that is doing 
the caching decide when it needs a new page causes problems. For example, when the 
35 information in a data source is important or is changing rapidly (for example, stock 
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5 prices), good service to the user requires that the information in the caches closely tracks 
the information in the data source. Similarly, there are many situations where caching 
all data that has been requested causes problems. For instance, in a cache run according 
to least recently-used principles, any HTML page that is produced by HTML program 
109 or received in browser 103 is cached and once cached, stays in the cache and takes 

10 up space that could be used for other HTML pages until it attains least recently-used 
status. 

When Web server 107 includes a Web application 111 involving a database server 115, 
there is still another problem with caching in web server 107: since the data is cached in 

15 the form of HTML pages, it is not in query able form, that is, a cached HTML page may 
contain data from which another query received from Web browser 103 could be 
answered, but because the data is contained in an HTML page instead of a database table, 
it is not in a form to which a query can be applied. Thus, even though the data is in 
server 107, server 107 must make the query, with the accompanying burden on data base 

20 server 115 and delays across network 113, and the HTML page containing the result of 
the query must be separately cached in server 107. 

What is needed to solve these problems is a web server 107 that has a cache in which 
cached data is to the extent possible in queryable form, in which the cached data is 
25 dependably updated when the data in the source changes, and in which selection of data 
from a source for caching is based on something other than the mere fact that a URL 
received from a web browser referenced the data. It is an object of the invention 
disclosed herein to provide servers and data sources that solve the above problems. 

30 Summary of the invention 

The problem of updating the server's cache is solved by having the sources of the cached 
information send update messages to the server each time the cached information changes 
in the information source. The problem of determining what to cache is solved by 
determining what to cache on the basis of probable future requests for the information. 
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5 The determination of what information will probably be made the subject of future 
requests can be made in the server, in the data source, or elsewhere. 

The problem of queryable data is solved by using a database system in the server as the 
cache. If the information necessary to run the query is present in the cache database 

10 system, the query is run on the cache database system; otherwise, it is run on a source 
database system. The cache database system is made transparent to application programs 
running on the server by setting up the data access layer so that it can run queries on 
either the source database system or the cache database system. The data access layer 
receives a query in standard form from the application program; it then determines 

15 whether the information needed for the query is present in the cache database; if it is, the 
data access layer runs the query on the cache database; if it is not, the data access layer 
runs the query on the source database system. 

In a further aspect of the invention, the standard form of the query uses global dataset 
20 identifiers, while the copies of the datasets in the cache database use local dataset 
identifiers. A query analyzer in the cache database receives the global dataset identifiers 
used in the query from the data access layer; if copies are present in the cache, the query 
analyzer indicates that to the data access layer and returns the local dataset identifiers for 
the copies to the data access layer. The data access layer then uses the local dataset 
25 identifiers to query the cache database. 

Other objects and advantages will be apparent to those skilled in the arts to which the 
invention pertains upon perusal of the following Detailed Description and drawing, 
wherein: 

30 

Brief description of the drawing 

FIG. 1 is an example of a prior-art system for performing queries via the World Wide 
Web; 

FIG. 2 is a high-level block diagram of a system of the invention; 
35 FIG. 3 is a detailed block diagram of details of an implementation of server 203; 
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5 FIG. 4 is a detailed block diagram of details of an implementation of source database 
server 237; 

FIG. 5 is a detail of cache database description 305; and 
FIG. 6 is a flowchart of the operation of query dispatcher 351 

10 Reference numbers in the drawing have three or more digits: the two right-hand digits 
are reference numbers in the drawing indicated by the remaining digits. Thus, an item 
with the reference number 203 first appears as item 203 in FIG. 2. 

Detailed Description 

15 The following Detailed Description will begin with a conceptual overview of the 
invention and will then describe a presently-preferred embodiment of the invention. 

Overview of the invention: FIG. 2 

FIG. 2 shows a system 201 for retrieving information via a network which includes one 
20 or more network servers 203(0. .n). Each server 203(i) includes a queryable cache 219 
that is automatically updated when information cached in cache 223 changes in source 
database 241 and in which the contents of cache 223 are determined by an analysis of 
what queries will most probably be made by users of server 203(i) in the immediate 
future. Server 203 is a Web server 107, and thus has an HTML component 109, a Web 
25 application component 111, and a data access component 253 which is a version of data 
access component 112 which has been modified to work with queryable cache 219. 
Server 203 could, however, communicate with its users by any other kind of network 
protocol. Server 203 further communicates with source data base server 237 by means of 
network 213, which may use any protocol which is suited to the purpose. 

30 

FIG. 2 shows one server 203, server 203(i), in detail. As before, Web application 111 
provides a query in a standard form to data access 253. Here, however, data access 253 
has access not only to source database server 237 via network 1 13, but also to queryable 
cache 219, which contains a cache data base 236 that has a copy 223 of a portion of the 
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5 data in source database 241. When data access 253 receives a query from web 
application 1 1 1, it first presents the query to queryable cache 219, as shown at Q 215. If 
cached data 223 includes the data specified in the query, queryable cache 219 returns 
result (R) 217, which data access 253 returns to Web application 111. If cached data 223 
does not include the data specified in the query, queryable cache 219 returns a miss signal 
10 (M) 216 to data access 253, which then makes the query via network 113 to source 
database server 237 and when it receives the result, returns it to Web application 111. 
The query made in response to the miss signal appears as miss query (MQ) 224 and the 
response appears as miss response (MR) 226. 

15 It is important to note here that because the interactions with queryable cache 219 and 
with source database server 237 are both performed by data access layer 253, the 
existence of queryable cache 219 is completely transparent to Web application 111. That 
is, a Web application program 1 1 1 that runs on Web server 107 will run without changes 
on Web server 203(i). 

20 

Continuing in more detail with queryable cache 219, the data cached in queryable cache 
219 is contained in cache database 236, which, like any database, contains data, in this 
case, copies of datasets (database tables) from source database 241 that are cached in 
queryable cache 219, and a query engine (QE 221), which runs queries on the datasets in 
25 cached data 223. The portion of queryable cache 219 which receives queries from data 
access layer 253 is data access interface 212. Data access interface 212 has two 
functions: 

• It determines whether the query can be executed on cached data 223 required to 
execute query 215 and generates miss signal 216 if it does not. 
30 • If cached data 223 does contain the data, it puts query 215 into the proper form for 
cache database 236. 

Data access interface 212 makes the determination whether the query can be executed by 
analyzing the query to determine the query's context, that is, what datasets are required to 
execute the query and then consulting a description of cached data 223 to determine 
35 whether these datasets are present in cached data 223. The datasets are specified in the 
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5 query by means of dataset identifiers, and consequently, the context is for practical 
purposes a list of the identifiers for the required data sets. The description 223 of course 
includes the dataset identifiers for the cached data sets. If the required datasets are 
present, data access interface 212 makes cache query 245, which has the form required 
to access the data in cache data base 236. Cache database 236 returns cache result 247, 
10 which data access interface 212 puts into the form required for result 217. 

Because cached data 223 is contained in cache database 236, cached data 223 is 
query able, that is, if a dataset is contained in cached data 223, queryable cache 219 can 
return as a result not only the entire dataset, but any subset of that dataset that can be 
15 described by a query. For example, if cached data 223 includes a dataset that lists all of 
the kinds of shirts sold by a company engaged in Web commerce and the list of kinds 
includes the colors that each kind of shirt is available in, queryable cache 219 will be able 
to handle a query for which the result is a list of the kinds of shirt that are available in 
red. 

20 

Cached data 223 is kept consistent with source database 241 by means of update 
transmitter 243 in source database server 237 and update receiver 210 in queryable cache 
219. Whenever a change occurs in source database 241 in a dataset of which there may 
be a copy in cached data 223, update transmitter 243 generates a cache update query 

25 (CUDQ) 234 specifying the change and sends CUDQ 234 via network 113 to each of 
servers 203(0,. n). Update receiver 210 receives CUDQ 234 from network 113 and 
determines from the data set description maintained by DA 212 whether the dataset is in 
face in cached data 223; if it is, it puts the cache update query into the proper form 251 
for cache database 236 and provides it to cache refresher 249, which then runs update 

30 query 251 on cache database 236. 

Data set manager (DSM) 213 decides generally what copies of datasets from source 
database server 237 are to be included in cache database 236. The information that DSM 
213 uses to make this determination is contained in query information 208. Query 
35 information 208 may be any information available to server 203(i) which can be used to 
predict what datasets of source database 241 will most probably be queried in the near 



9 



oracleOl.OOl 



5 future. For example, if a company engaged in Web commerce is having a 1-day sale on 
certain items for which there are datasets in source database 241, query information 208 
may indicate the datasets for the items and the time of the 1-day sale. Using that 
information, DSM 213 can obtain the datasets from source database 241 and cache them 
in cache database 236 before the beginning of the sale and remove them from cache 
10 database 236 after the end of the sale. 

Another kind of query information 208 is a query log, a time-stamped log of the queries 
received from data access layer 253; if the log shows a sharp increase in the occurrence 
of queries for a given dataset, DSM 213 should cache the datasets for that query in cache 

15 219 if they are not there already. Conversely, if the log shows a sharp decrease in the 
occurrence of such queries, DSM 213 should consider removing these datasets from 
queryable cache 219. When DSM 213 determines that a dataset should be added to 
query able cache 219, it sends a new data query (NDQ) 218 via network 113 to source 
data base 241 to obtain the new data and when DSM 213 has the response (NDR 220), it 

20 sends a delete query to query engine 221 indicating the data to be deleted in cached data 
223 to make way for the new data and then sends a cache update query 251 to cache 
refresher 249 to update the cache. 

Data set manager 213 and query information 208 may also be implemented in part in 
25 source data base server 237 or anywhere where information about the probability of 
future queries may be obtained. When implemented in source data base server 237, the 
query log would log each query 231 to source database 241 and at least the portion of 
data set manager 213 which reads the query log to determine what new data needs to be 
cached would be in source database server 237; when it determined that new data needed 
30 to be cached, it would send an update query with the new data to each of the servers 203. 
The component of DSM 213 that determines what is to be removed could also be in 
source database server 237, in which case, all queryable caches 219 would contain the 
same data in cached data 223, or that component could be in each server 203(i), with the 
component making decisions concerning what data to remove to accommodate the new 
35 data based on the present situation in server 203(i). In such an arrangement, there can be 
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5 a local query log in each server 203 in addition to the global query log in source database 
server 241. Such an arrangement would permit different servers 203 to have different- 
sized caches 223; it would also permit different servers 203 to take local variations in the 
queries they are receiving into account in determining what data to remove from cache 
219. One way such variations might occur is if system 201 were set up so that different 
10 servers 203 preferentially received queries from users in different geographical locations. 

FIG. 2 shows only a single source database server 237; there may of course be more than 
one; moreover, source database server 237 need not be a classical database system. 
Server 203 (i) can be set up to be used with data sources containing any kind of queryable 

15 data, where queryable is defined as having a form which can be represented as a set of 
numbered rows of data. Such a set of numbered rows is termed a rowset. Database 
tables are of course one example of rowsets; others are files of data records, text files, 
and still and moving image data. If server 203 (i) is used with data sources having only a 
single kind of queryable data, queryable cache 219 need only be set up to deal with that 

20 kind of queryable data. 

If server 203 (i) is used with data sources having more than one kind of queryable data, 
cache database 236 may be set up using a rowset representation that will accommodate 
all of the different kinds of queryable data. In that case, DA 212, DSM 213, and update 
25 receiver 210 will translate between the results and update queries received from the 
various data sources and the representations used in cached data 236. In other 
embodiments, there may be more than one cache database 236 in queryable cache 219, 
with different cache databases being used for different kinds of queryable data. Again, 
DA 212, DSM 213, and update receiver 210 will perform the necessary translations. 

30 

Details of a preferred embodiment of a data access layer and a queryable cache: 
FIGs. 3, 5, and 6 

FIG. 3 shows a preferred embodiment 301 of data access 349 and queryable cache 302. 
Corresponding components of FIGs. 2 and 3 have the same names. Cache database 347 
35 in embodiment 301 is an Oracle8 Server, which is described in detail in Leverenz, et al, 
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5 Oracle8 Server Concepts, release 8.0, Oracle Corporation, Redwood City, CA, 1998. In 
preferred embodiment 301, Web application 111 uses global data set identifiers in 
queries. The Web applications 1 1 1 in all of the servers 203 use the same set of global 
data set identifiers. A cache data base 347 in a given server 203 has its own set of local 
data set identifiers for the data sets cached in cache data base 347. In preferred 
10 embodiment 301, then, one may speak of global queries and query contexts that use 
global data set identifiers and local queries and query contexts that use local data set 
identifiers. In the preferred embodiment, query analyzer 313 uses cached data base 
description 305 to translate global query contexts into local query contexts. 

15 Data access layer 349 includes a new component, query dispatcher 351, which is the 
interface between data access layer 349 and queryable cache 302. FIG. 6 is a flowchart 
601 of the operation of query dispatcher 351 in a preferred embodiment. Reference 
numbers in parentheses refer to elements of the flowchart. When data access layer 349 
is preparing to query source database 241, it provides the global context for the query to 

20 query dispatcher 351 (605) , which in turn provides global context 318 (FIG. 3) to query 
analyzer 313 (607). Query analyzer 313 determines whether the datasets identified by the 
global context are cached in cache database 347; if they are not, query analyzer 313 
reports a miss 3 19 to query dispatcher 351 (609), which indicates to data access layer 349 
that it is to place the global query on network 113. 

25 

If the datasets identified by the global context are cached in cache database 347, query 
analyzer 313 indicates that fact to query dispatcher 351 and also provides query 
dispatcher 351 with local context 316 for the datasets in cache database 347 (615). Query 
dispatcher 351 then provides the local context to data access layer 349, which uses the 

30 local context to make a local query 317 corresponding to the global query and then uses 
the local query to obtain local result 320 from cache database 347. It should be noted 
here that the operations involved in the translation from the global query to the local 
query and applying the local query to cache database 347 may be divided among data 
access layer 349, query dispatcher 351, and query analyzer 313 in many different ways; 

35 the advantage of the technique of flowchart 601 is that data access layer 349 can employ 
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5 the same mechanisms to make local queries as it does to make global queries. All query 
analyzer 313 and query dispatcher 351 need do is supply data access layer 349 with the 
local context needed to make the local query. 

Continuing with the details of query able cache 302 and beginning with DA interface 304, 
10 interface 304 receives a global context 318 from query dispatcher 351 and depending on 
whether the datasets for the queries are in cache database 347, provides either local 
context 316 or a miss signal 319. DA interface 304 has two main components: query 
analyzer 313 and cache database description manager 303. 

15 Query analyzer 313 analyzes global contexts received from data access layer 253 and 
other components of embodiment 301 to obtain the global context's global dataset 
identifiers. Having obtained the global dataset identifiers, query analyzer 313 provides 
them to CDB description manager 303, which looks them up in cache database 
description 305. Cache database description 305 is a table of datasets. At a minimum, 

20 there is an entry in the table for each dataset that has a copy in cache database 347. Each 
such entry contains the dataset 5 s global identifier and its local identifier. The table also 
contains query information 307. CDB description manager 303 then returns an indication 
of whether the dataset is in cache database 347 (H/M 311). If it is not, the query cannot 
be run on cache database 347, but must be run on source database 241, and consequently, 

25 query analyzer 313 returns a miss signal 319 to query dispatcher 351. If the query can 
be run on cache database 347, query analyzer 313 returns a hit signal 319 and also returns 
local context 316 for the query. As indicated above, query dispatcher 351 then provides 
local context 316 to data access layer 349, which uses it to make local query 317 on 
cache database 347. Cache database 347 then returns local result 320 to data access layer 

30 349. 

FIG. 5 shows details of CDB description 305. In a preferred embodiment, it is a table 
which has at least an entry 501 for each dataset of source database 241 of which here is a 
copy in cache database 347. Each entry 501 contains the global dataset identifier for the 
35 data set, by which the dataset is known in all servers 107 with queryable caches 219 
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5 containing copies of the dataset, the local data set identifier 505, by which the dataset is 
known in cache database 347, and number of queries 507, which indicates the number of 
times the dataset has been queried over an interval of time. In the preferred embodiment, 
number of queries 507 embodies query information 307. 

10 An entry 501(i) for a given dataset is accessed in a preferred embodiment by a hash 
function 503, which takes global dataset ID 507 for the dataset and hashes it into an entry 
index 509 in table 305. CDB description manager 303 then searches table 305 for the 
entry 501 whose field 503 specifies global DSID 511 beginning at entry index 509. If no 
such entry is found, the dataset is not in cache database 347 and CDB description 

15 manager 303 signals a miss 311 to query analyzer 313. Table 305 may also include 
entries 501 for global datasets that are not presently cached in cache database 347; in 
such entries, local dataset ID 505 has a null value and a miss is returned in response to 
the null value. The purpose of such entries is to maintain number of queries information 
507 for such data sets, so that dataset manager 323 can determine whether to add the 

20 entry's dataset to cache database 347. 

Update Rcvr 321 receives update queries provided by source database server 237 from 
data access 253 and uses query analyzer 313 to determine whether the dataset affected by 
the update is in cache database 347. If it is not, update rcvr 321 ignores the update; 
25 otherwise, it places update query 329 in change queue 333. Refresher 331 reads queue 
333 and executes its queries. 

Data store manager 323 uses query information 307 in CDB description 305 to determine 
what datasets to add to or delete from cache database 347. With datasets to be added, 
30 DSM 323 makes the necessary queries to source database 241 and when the results 
arrive, DSM 323 makes them into update queries 239 and provides the update queries 
329 to change queue 333, from which they are executed by refresher 331 as described 
above. DSM 323 further updates CDB description 305 as required by the changes it 
makes in cache database 347, as shown at 327. 

35 
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5 In a preferred embodiment, DSM 323 and refresher 331 have their own threads or 
processes. It should also be pointed out here that CDB description 305 and change queue 
333 could be implemented as database tables in cache database 347. Because these 
components are implemented independently of cache database 347 and because abstract 
query translator 339 is used as an interface to cache database 347, embodiment 301 is to a 

10 large extent independent of the particular kind of database system employed to 
implement cache database 347. In embodiment 301, data access 203 only provides read 
queries to data access interface 304. All update queries go directly to server 237, without 
the update being entered in cache database 347. In other embodiments, queryable cache 
219 may be implemented as a writethrough cache, i.e., the update may be entered in 

15 cache database 347 and also sent to server 237. It should be pointed out here that most 
Web applications are mostly-read applications, that is, a Web user typically spends far 
more time reading information than he or she does changing it. For instance, in Web 
commerce, the "shopping" is mostly a matter of reading HTML pages, with updates 
happening only when the user adds something to his or her "shopping cart" or makes his 

20 or her purchases. In a system such as system 201, only making the purchases would 
typically involve an update of source database 241 . 

Details of source database server 237: FIG, 4 

FIG. 4 shows a preferred embodiment of source database server 237. Source database 
25 server 237 in the preferred embodiment is implemented by means of an Oracle8 server 
executing on a computer system that includes a disk drive 421 on which is stored source 
database 241 and memory 415 which contains buffer cache 407 for copies of data values 
421 from database 241 and dictionary cache 409 for copies of metadata from database 
241. Metadata is database tables whose contents describe the data in the database. 
30 Writebacks of cached data in server memory 415 to source database 241 are handled by 
database write process 325. Each of processes 401(0..n) represents and corresponds to a 
server 203 and handles queries resulting from cache misses, update queries, and queries 
from DSM 323 in the corresponding server 203. Dispatcher 311 gives each of these 
processes in turn access to shared server process 317, which performs the actual queries 
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5 and returns the results to the querying process, which in turn returns the results via 
network 235 to its corresponding server 203. 

The Oracle8 implementation of source database server 237 is a standard Oracle8 database 
system to which has been added an implementation of update transmitter 243, which 

10 automatically sends an update to queryable cache 219 in each of the servers 203(0..n) 
when data in source database 241 that has been copied to cached data 223 changes. The 
components of updater 243 in FIG. 4 are labeled with the reference number 243 in 
addition to their own reference numbers. The implementation of updater 243 in the 
preferred embodiment employs database triggers. A database trigger is a specification of 

15 an action to be taken if a predefined change occurs in a data value or an item of metadata 
in the database. Many database systems permit definition of triggers; triggers in the 
Oracle8 database system are described in detail at pages 17-1 through 17-17 of the 
Leverenz reference. 

20 In the preferred embodiment, when a process 401(i) corresponding to a server 203 (i) 
receives a query from DSM 323 in server 203(i) for data to be added to server 203(i)'s 
cached data 223, process 203 (i) executes set trigger code 403. This code sets an Oracle8 
AFTER row trigger in metadata 417 for each row of data and/or metadata specified in the 
query. Shared server process 317 takes the action specified in the trigger whenever the 

25 trigger's row of data has been modified. The action specified for the trigger is to send a 
message to each of the servers 203(0.. n) with an update query that modifies the data in 
cached data 223 in the same fashion as it was modified in source database 241. In the 
preferred embodiment, the action performed by the trigger is to place the message with 
the update query in message queue 414, which is implemented as an Oracle8 advanced 

30 queue. Message queue 414 is read by update process 402, which sends the messages in 
queue 414 to each of the servers 203(0..n). 

Adding new data to cached data 223 in response to or in anticipation of changes in the 
behavior of the users of internet 105 and updating cached data 223 in response to 
35 changes in source database 241 may of course be implemented in many other ways in the 
preferred embodiment shown in FIGs. 3 and 4. For example, determining what data 
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5 should be in cached data 223 could be done in source DBS server 237 instead of in each 
of the servers 203. Source database 241, like the cached databases 347 in the servers 
203(0..n), can maintain statistics information, and a send process 404 in source server 
237 can analyze the statistics in substantially the same fashion as described for DSM 323 , 
determine what data should be sent to the servers 203(0..n) for caching in cached data 

10 223 , make update queries for that data, and place messages containing the update queries 
in message queue 414, from which update process 402 can send them to the servers 203. 

Updating cached data 223 in response to changes in source database 241 can also be 
implemented without triggers. The Oracle8 database system includes a redo log 413 in 

15 source server memory 415 which is a circular buffer of updates that have been performed 
on source database 241. The database system maintains the log so that it can redo 
updates in case of system failure, but the log can also be used to update cached data 223. 
If there is a table in source database 241 which describes cached data 223, update process 
402 can use the table in conjunction with redo log 413 to determine whether an update in 

20 redo log affects cached data 223. If it does, update process 402 can send a copy of the 
update query to the servers 203 as just described. 

Caching servers and source servers that do not involve database systems 

The techniques used to determine what data should be cached in server 203 and to update 
25 cached data 223 can also be employed in systems where the data is not queryable. For 
example, the source data may simply be a collection of documents, identified perhaps by 
a document number (such as its URL, if the document is an HTML page), and the cached 
data may be simply a subset of the collection. What cache web application 211 would 
receive from HTML component 109 in such a system would simply be the document 
30 number for a document; if it is present in the cached data, the caching server would return 
it from there; otherwise, it would fetch it from the source server. Query log 205 in such 
a case would be a time-stamped list of the documents that had been requested, together 
with an indication of whether the document was in the cached data. DSM 213 in such an 
embodiment would determine as described above for the database whether a document 
35 should be included in the cached data, and having made the determination, would obtain 
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5 it from the source server. As also described above, a send component on the source 
server could make the same determination and send the document to the caching servers. 

For update purposes, the source server would simply maintain a list of the documents that 
were presently in the caching servers; if one of the documents on the list was updated, 
10 updater 243 would send the new version of the document to the caching servers, where 
DSM 213 would replace any copy of the document in the cache with the new copy. The 
techniques just described for documents could of course also be used with files and with 
audio, image, and motion picture data. 

15 Conclusion 

The foregoing Detailed Description has described a Web server which implements the 
principles of the inventions set forth herein. The inventions are of course not limited to 
Web servers, but may be used in any situation where a cache needs to be kept coherent 
with the source of the cached data, where there is a need to determine what is going to be 
20 cached, where it is desirable to query the cached data, and where it is desired to make the 
cache transparent to programs running at a higher level. While the inventors have 
disclosed the best mode presently known to them of implementing their inventions, it will 
be immediate apparent to those skilled in the arts to which the inventions pertain that 
there are many other ways of implementing the principles of the inventions. 

25 

For all of the foregoing reasons, the Detailed Description is to be regarded as being in all 
respects exemplary and not restrictive, and the breadth of the invention disclosed here in 
is to be determined not from the Detailed Description, but rather from the claims as 
interpreted with the full breadth permitted by the patent laws. 

30 
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1 1. A server in a network that receives requests from users of the network for information 

2 belonging to an information source that has access to the server, 

3 the server comprising: 

4 a partial copy of the information belonging to the information source from which 

5 the server provides the information when the requested information is contained therein; 

6 and 

7 an updater that updates the partial copy in response to update information which 

8 the information source provides the server when information in the partial copy is 

9 updated in the information source. 

1 2. A server in a network that receives requests from users of the network for information 

2 belonging to an information source to which the server has access, 

3 the server comprising: 

4 a partial copy of the information from which the server provides the requested 

5 information when the requested information is contained therein and 

6 an information fetcher that does not automatically fetch information from the 

7 information source to the partial copy when the information is not contained therein but 

8 rather fetches the information when needed for a probable future request. 

1 3. The server set forth in claim 2 wherein: 
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2 the information fetcher makes a determination of what information is needed for a 

3 probable future request on the basis of information usage information maintained in the 

4 server and fetches information on the basis of the determination. 

1 4, The server set forth in claim 2 wherein: 

2 the information fetcher receives a determination of what information is needed for 

3 a probable future request from a source external to the server and fetches information 

4 according to the determination. 



1 5. A server in a network that receives requests from users of the network for information 

2 belonging to an information source that has access to the server, 

3 the server comprising: 

4 a partial copy of the information belonging to the information source from which the 

5 server provides the information when the requested information is contained therein; and 

6 an updater that updates the partial copy in response to update information which the 

7 information source provides the server on the basis of a determination made at the 

8 information source of a probable future request for information. 



1 6. An information source that has access to one or more servers in a network, each server 

2 including a partial copy of the information in the information source and the information 

3 source having the improvement comprising: 

4 an updater that responds to an update of information in the information source that 

5 is contained in the partial copy by providing the update to the server. 
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1 7. The information source set forth in claim 6 wherein: 

2 the information source is a database system of the type wherein trigger code may be 

3 associated with the information, the trigger code being executed when the information is 

4 updated; and 

5 the updater is trigger code which is associated with information contained in the 

6 partial copy, the trigger code responding to an update of the information by providing the 

7 update to the server. 

1 8. The information source set forth in claim 6 or claim 7 wherein: 

2 the information source provides the information contained in the partial copy to 

3 the server; and 

4 the updater determines the information that is contained in the partial copy from 

5 the provision thereof by the server. 

1 9. The information source set forth in claim 8 wherein: 

2 the information source provides further information for the partial copy to the server in 

3 response to a request from the server. 

1 10. The information source set forth in claim 8 wherein: 

2 the information source provides the further information on the basis of a 

3 determination made at the information source of a probable future request for 

4 information. 
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1 11. The information source set forth in claim 10 wherein the information source further 

2 comprises: 

3 a log of requests for information and 

4 the information source makes the determination using the log of requests. 

1 12. The information source set forth in claim 10 wherein: 

2 the information source uses information about an event that will result in requests to 

3 make the determination. 

1 13. The information source set forth in claim 12 wherein: 

2 the information source uses information about a time of occurrence of the event to 

3 make the determination. 

1 14. The information source set forth in claim 8 wherein: 

2 the information source provides further information for the partial copy to the server 

3 on the basis of a determination made elsewhere of a probable future request for information. 

1 15. An information source that has access to one or more servers in a network, each 

2 server including a partial copy of the information in the information source and the 

3 information source having the improvement comprising: 

4 an information sender that determines a probable future request for information 

5 and provides the information for the probable future request to the server. 
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1 16. The information source set forth in claim 15 wherein the information sender further 

2 comprises: 

3 a log of requests for information and 

4 the information sender makes the determination using the log of requests. 

1 17. The information source set forth in claim 15 wherein: 

2 the information sender uses information about an event that will result in requests to 

3 make the determination. 

1 18. The information source set forth in claim 17 wherein: 

2 the information sender uses information about a time of occurrence of the event to 

3 make the determination. 

1 19. The information source set forth in claim 15 wherein: 

2 the information source provides the information on the basis of a determination made 

3 elsewhere of a probable future request for information. 

1 20. A method employed by an information source to update a partial copy of the information 

2 in the information source that is contained in a server accessible to the information 

3 source, 

4 the method comprising the steps of: 

5 detecting a change in information in the information source that is also in a partial 

6 copy; and 
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7 sending an update message indicating the change to the server. 



1 21. An improved middle-tier Web server of the type that has an HTML layer for providing 

2 HTML pages in response to URLS, a Web application layer for providing data for the 

3 HTML pages in response to messages accompanying the URLs, and a data access 

4 layer that responds to requests from the Web application layer by querying remote 

5 datasets and returning a response to the query to the Web application layer, 

6 the server having the improvement comprising: 

7 a queryable cache containing copies of certain of the remote datasets, 

8 the data access layer determining whether a copy of a dataset to be queried is present in 

9 the queryable cache and if the copy is present, querying the copy, and otherwise querying the 
10 remote data set. 



1 22. The improved Web server set forth in claim 21 wherein 

2 the query employs global identifiers for the remote data sets; 

3 the copies are identified by local identifiers; 

4 and the improvement further comprises: 

5 a query analyzer which responds to a global identifier by returning an indication 

6 whether the remote dataset identified by the global identifier has a copy in the cache and if the 

7 remote dataset has a copy, returning the local identifier for the copy, 

8 the data access layer responding to a returned indication that the remote dataset does not have a 

9 copy by querying the remote data set and responding to a returned indication that the remote 
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10 dataset does have a copy by querying the queryable cache using the returned local identifier for 

1 1 the copy. 

1 23. The improved Web server set forth in claim 22 wherein: 

2 the data access layer provides a global query context including all of the global 

3 identifiers used in the query to the query analyzer; 

4 when there are copies of all of the remote datasets identified in the global query context, 

5 the returned indication returned by the query analyzer so indicates and the query analyzer returns 

6 a local query context including the local identifiers for the copies; and 

7 the data access layer uses the local query context to query the queryable cache. 

1 24, An improved data access interface of the type used in a server to provide a program with a 

2 standard interface for querying remote datasets, 

3 the improvement comprising: 

4 a queryable cache that contains copies of certain of the datasets and is accessible to the 

5 data access interface, 

6 the improved data access interface receiving a query for a remote dataset in a form required by 

7 the interface from the application program, determining whether a copy of a dataset to be queried 

8 is present in the queryable cache, and, if the copy is present, querying the copy, and otherwise 

9 querying the remote dataset, 

10 whereby the queryable cache is transparent to the program. 
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1 25. The improved data access interface set forth in claim 24 wherein 

2 the program uses global identifiers for the remote data sets and 

3 the copies in the queryable cache have local identifiers; and 

4 the improved data access interface further comprises: 

5 a query analyzer that receives the global identifier for a dataset being queried and if 

6 there is a copy of the data set indicated by the global identifier, returns the local identifier to the 

7 data access interface, 

8 the data access interface using the local identifier to query the copy. 

1 26. The improved data access interface set forth in claim 24 wherein: 

2 the query analyzer further indicates to the data access interface whether the copy of the 

3 dataset is in the queryable cache. 



1 27. The improved data access interface set forth in claim 24 further comprising: 

2 a dataset manager that determines a dataset for which a copy is needed in the cache, 

3 obtains a copy of the remote dataset and adds the copy to the cache. 

1 28. The improved data access interface set forth in claim 27 wherein: 

2 the dataset manager further determines a dataset for which a copy is no longer needed in 

3 the cache and removes the copy from the cache. 



1 



29. The improved data access interface set forth in any of claims 27 or 28 wherein: 
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2 the dataset manager determine whether to add or remove a dataset by determining a 

3 likeliness that a query will be made to the dataset. 

1 30. The improved data access interface set forth in claim 29 wherein the improved data access 

2 interface further comprises: 

3 a query log that lists past queries that have been made to the standard interface and 

4 the dataset manager uses the query log to determine a likeliness that a query will be 

5 made to a dataset. 

1 31. The improved data access interface set forth in claim 29 wherein: 

2 the dataset manager uses information about an event that will result in queries to a 

3 dataset to determine a likeliness that a query will be made to a dataset. 

1 32. The improved data access interface set forth in claim 3 1 wherein: 

2 the dataset manager uses information about a time of occurrence of the event to 

3 determine a likeliness that a query will be made to a dataset. 

1 33. The improved data access interface set forth in claim 24 wherein 

2 when a change occurs in a remote dataset, an indication of the change is sent to the 

3 server and 

4 the improved data access interface further comprises: 
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5 an update receiver that receives the indication and modifies any copy of the dataset as 

6 required by the indication. 

1 34. A method of using a data access interface in a server to query remote datasets, the data 

2 access interface being of a type that provides a standard interface for querying the 

3 remote data sets to a program and the data access interface having access to a queryable 

4 cache that contains copies of certain of the remote datasets and 

5 the method comprising the steps of: 

6 receiving a query for a remote dataset in a form required by the standard interface; 

7 determining whether a copy of a dataset to be queried is present in the queryable cache; 

8 and 

9 if the copy is present, querying the copy and otherwise querying the remote dataset, 
10 whereby the queryable cache is transparent to the program. 



1 35. The method set forth in claim 34 wherein 

2 the program uses global identifiers for the remote data sets and 

3 the copies in the queryable cache have local identifiers; and 

4 the method further includes the steps of : 

5 receiving the global identifier for a dataset being queried; and 

6 if there is a copy of the data set indicated by the global identifier, returning the local 

7 identifier to the data access interface, 

8 the local identifier being used in the step of querying the local copy. 
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Abstract of the Disclosure 

5 A middle-tier Web server with a queryable cache that contains items from one or more 
data sources. Items are included in the cache on the basis of the probability of future hits 
on the items. The probability determination may be made by an element located in the 
Web server, at the data source, or elsewhere in the network to which the Web server and 
the data source belong. The determination may be made by analyzing the hit rates on 

10 item or by means of information such as a period of time during which frequent hits can 
be expected. When the data source determines that an item that has been included in the 
cache has changed, it sends an update message to the server, which updates the item if it 
is still included in the cache. In a preferred embodiment, the data source is a database 
system and triggers in the database system are used to generate update messages. In a 

15 preferred embodiment, the data access layer determines whether a data item required by 
an application program is in the cache. If it is, the data access layer obtains them from 
the cache; otherwise, it obtains them from the data source. In the preferred embodiment, 
the Web application programs use global data set identifiers to identify data sets, while 
the cached data sets are identified by local data set identifiers. The cache receives a 

20 query context of global data set identifiers, determines whether the data sets of the query 
context are cached, and if they are, provides the local data set identifiers for the query 
context to the access layer, which then uses the local data set identifiers to query the 
cache. 

25 
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believed to be true; and further that these statements were made with the knowledge that wiliful false statements and the like so made are 
punishable by fine or imprisonment, or both, under 18 U S C. 1001 and that such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 



Name of Sole or First Inventor: 



D A petition has been filed for this unsigned inventor 



Given Name (first and middle [if anvl) 



Family Name or Surname 



Michael J. 



Cu s son 




Inventor's 
Signature 



Date 



Residence: City 



ie 1ms ford 



MA 



Country 



USA 



Citizenship 



USA 



Post Office Address 



19 Old Farm Way 



Post Office Address 



City 



Che 1ms ford 



State MA 



ZIP 



01824 



Country 



USA 



13 Additional inventors are being named on the _j„supplemental Additional Inventor(s) sheet(s) PTO/SB/02A attached hereto 

[Page 2 of 2] 



Please type a plus sign (+) inside this box 



PTO/SB/02A (3-97) 
Approved for use through 9/30/98. OMB 0651-0032 
Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a 
valid OMB control number. 



+ 



DECLARATION 



ADDITIONAL INVENTOR(S) 
Supplemental Sheet 

Page of 1 



Name of Additional Joint Inventor, if any: 



[ | A petition has been filed for this unsigned inventor 



Given Name (first and middle [if any]) 



Family Name or Surname 



Ramu 



Sunkara 



Inventor's 
Signature 



Date 



Residence: City 



Reading state M A 



Country 



USA 



Citizenship 



USA 



Post Office Address 



283 Grove St. 



Post Office Address 



City 



Reading 



State 



MA 



ZIP 



01867 Country USA 



Name of Additional Joint Inventor, if any: 



A petition has been filed for this unsigned inventor 



Given Name {first and middle [if any]} 



Family Name or Surname 



Inventor's 
Signature 



Date 



Residence: City 



State 



Country 



Citizenship 



Post Office Address 



Post Office Address 



City 



State 



ZIP 



Country 



Name of Additional Joint Inventor, if any: 



|~~| A petition has been filed for this unsigned inventor 



Given Name (first and middle [if any]} 



Fam ily Name or Surname 



Inventor's 
Signature 



Date 



Residence: City 



State 



Country 



Citizenship 



Post Office Address 



Post Office Address 



City 



State 



ZIP 



Country 



+ 



Burden Hour Statement: This form is estimated to take 0.4 hours to complete. Time will vary depending upon the needs of the individual case. Any 
comments on the amount of time you are required to complete this form should be sent to the Chief Information Officer, Patent and Trademark 
Office, Washington, DC 20231. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for 
Patents, Washington, DC 20231. 



